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ABSTRACT 

School improvements have been implemented in 27 
schools in Columbus, Ohio, emphasizing the characteristics of 
effective schools. These characteristics include: (1) a sense of 
mission; (2) strong instructional leadership; (3) high expectations 
for students as well as school staff; (4) frequent monitoring of 
student progress; (5) a positive learning climate; (6) sufficient 
opportunity for learning to occur; and (7) parent/community 
involvement in the school program. A needs assessment was 
administered in 12 of the schools using a pretest/posttest design. 
Scores on standardized achievement tests were considere . Home-school 
relations was identified as a factor much in need of improvement. The 
change in reading comprehension scores from the pretest to the 
posttest was slightly greater than had been expected. The growth in 
mathematics computation ability w^s substantial. Pupils from lower 
income families tended to score lower in both subjects. Seventeen 
tables and 7 appendices present statistical data. (VM) 
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ABSTRACT 



Program Descript ion: v^arious school improvement efforts, which were 
implemented in a total ot 27 Columbus schools during the period J 982-86, have 
continued at some schools during the 1986-87 school year. The goal of these 
efforts, as in the past, was to emphasize those factors which educational 
research has identified to be characteristic of effective schools, or schools 
in which all pupils regardless of socioeconomic background succeed in acquiring 
a mastery of basic skills, particularly in reading and mathematics. Effective 
schools are characterized by a sense of mission, strong instructional 
leadership, high expectations for students as well as school staff, frequent 
monitoring of pupil progress, a positive learning climate, sufficient 
opportunity for learning to occur, and parent/community involvement in the 
school program. 

Ti me Interval ; The effective schools effort coincided with the school year. 
Tha Needs Assessment Surv^ey was administered during September, 1986. A pretest 
was administered in late September, 1986, and a posttest in early April, 1987. 
Students included in the pretest-posttest analysis must have taken both pretest 
and posttest in the same school and must have had a valid score on each. 

Evaluation Design ; The evaluation of the effective schools effort was 
accomplished by the administration of a locally developed Needs Assessment 
Survey, and a pretest-posttest of student achievement using the Comprehensive 
Tests of Basic Skills (CTBS; 1981) to answer the following evaluation 



1.1 What were the results of ttie Needs Assessment Survey? 

2.1 How did students score on the standardized achievement 
tests in relation to the national norm group? 

2.2 How did students of different socioeconomic status 
score on the standardized achievement tests m 
relation to the national norm group? 

M ajor Findings ; Six schools, four middle and two elementary, elected to 
administer the Needs Assessment Survey to teaching staff. The instrument, 
prepared by the Department of Evaluation Services, is based on seven factors 
considered characteristic of effective jjchools. While results varied from 
school to school, one factor in particular, home-school relations was 
identified by all staffs as an area where improvement was needed. This finding 
is consistent with earlier administrations of the survey in other schools 
during the last four year. 



questions; 
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Pretest-posttest scores in both reading and mathematics were obtained from 
nearly 8,400 pupils in grades 1-8 attending the 26 participating schools. 
Analyses of these scores, obtained from the Comprehensive Tests of Basic Skills 
(CTBS; i98i), showed the pupils" change in achievement \/as slightly greater 
tnan expected in Reading Comprehension. The growth in Mathematics Computation 
was substantial with 25.9% more of the pupils at grade level on the posttest 
than at grade level on the pretest. The comparable figure for Reading 
Comprehension was 2.8%, Analyses indicated that pupils from lower income 
families scored consistentl> lower in both reading and roathematicj. This has 
been true tor each of the five years that effective schools research has been 
conducted in the Columbus schools. In fact, the pattern of pupil growth in 
mathematics and reading, regardless of which standardized test was used, also 
has been consistent during the five year of effec-.ive schools research. The 
growth in pupil achievement as measured by NCE points and the percent of pupils 
at grade level from the fall pretest to the spring posttest has been 
consistently larger for mathematics than for reading. The following table 
summarizes the achievement gains for ail pupils in reading and mathematics for 
the pas'j five years. The reader is advised that the expected change between 
pretest and posttest is zero. 



Table i 

Achievement Gains as Measured 
by Change in NCE Points and Percent 
of Pupils at Grade Level from Pretest 
to Posttest in each Program Year 



Reading Mathe ma tics 

Program Average NCE % at Grade Average NCE % at Grade 

Year Change Level Change Change Level Change 



1982-83 


4.2 


1U9 


13.6 


31.4 


1983-84 


4.9 


11,7 


10.8 


23.4 


1984-85 


0.6 


0.5 


9.5 


19.2 


1985-86 


2.9 


3.1 


12.7 


25.8 


1986-87 


2.1 


2.8 


13.0 


25.9 
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LNTERIM EVALUATION REPORT 
HiFFECTIVE SCHOOLS REPORT 



An effective school, according to Edmonds (1982) and other educational 
rese^irchers (Broukover 1978, 1982), is one i. which all papils succeed in 
acquiring a mastery of basic skills, regardless of the pupils' socioeconomic 
backgrounds. Effective schools have the following characteristics in common, 
according to the State Department of Education Division of Equal Educational 
Opportunities (1981); 

1# A Sense of Mission 

2. Strong Building Leadership 

3. High Expectations for All Students and Staff 

4. Frequent Monitoring of Student Progress 

5. A Positive Learning Climate 

6. Sufficient Opportunity for Learning 

7. Parent/Community Involvement 

The School Improvement Program (SIP) was implemented in a total of 27 
Columbus schools during a four year period, from 1982 to 1986 (Appendix A). 
The goal of SIP was to improve the academic achiev,ement of pupils in the basic 
skill areas, particularly in reading comprehension and mathematics computation, 
as well as to lessen the disparity in achievement levels between pupils of 
different socioeconomic backgr'unds. Providing building level inservice 
programs related to the characteristics of effective schools was a key element 
in the program effort, as were yearly assessments of educational needs at each 
school, and the administration of a pretest and posttest at each school during 
the school year. 

Although the SIP officially ended with the 1985-86 school year, school 
improvement efforts have continued at a number of schools (Appendix B). During 
the 1986-87 school year, six schools conducted a needs assessment during 
September, using the Needs Assessment Survey developed for the SIP by the 
Department of Evaluation Services. A total of 26 schools administered the 
Comprehensive Tests of Basic Skills (CTBS; 1981) as a prt^test of student 
achievement during September, 1986. Seven schools administered the pretest 
because of their participation in the Urban Development Program, one because of 
participation in a Lazarus Quality School Grant, and 18 because the principal 
of the building requested the testing. In addition to these 26 schools, 60 
pupils were tested at West High School as part of the Apple Classroom of 
Tomorrow (ACOT). The ACOT results are not included in this report. The 
Department of Evaluation Services provided technical assistance to the schools 
in the areas of providing and distributing necessary materials, collecting the 
resultant data, analyzing the data, and reporting the results to the schools. 



Evaluation Design 

The major finaings from the administration of the Needs Assessment Survey 
(NAS) and the pretest-post test of student achievement using the Comprehensive 
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Tests ot Basic Skills (CTBS; 1981) are reported herein in response to the 
toiiowing evaluation questions: 

i.i Question : vNEEDS ASSESSMENT SURVEY) 

What were the results of the Needs Assessment Survey? 

2.1 Question ; (STANDARDIZED ACHIEVEMENT TEST) 

How did students score en the standardized achievrement tests in relation 
to the national norm group? 

2.2 Question: (STANDARDIZED ACHIEVEMENT TEST) 

How did students of different socioeconomic status score on the 
standardized achievement tests in relatior* to the national norm group? 



Maj or Findings 

The tollowmg is a report on those activities that have received technical 
support services from the Department of Evaluation Services: I. I Needs 
Assessment Survey, 2.1-2.2 Standardized Achievement Test Administration. 

I. I Needs Assessment 



School staff at six schools, four middle and two elementary, completed the 
Needs Assessment Survey (NAS) during the month of September, 1986. The NAS was 
prepared by the Depart nt of Evaluation Services, based on an interview 
schedule developed and used by the Connecticut State Department of Education. 
The NAS, as used in the Columbus schools, consisted of 67 items, each having 
five response choices. The response choices for each item consisted of brief 
narrative descriptors, lettered "A" through "E" representing a continuum from 
less than ideal ('"'A") to ideal ("E"), where ideal represents a school 
environment or condition considered appropriate according to the literature of 
effective schools. Th<; items composing the NAS are divided into seven 
categories or factors, each representing an important aspect of ^'effective 
schools," as shown in Table 1. 

Table 1 



NAS Items Composing Seven Effective Schools Factors 





Factor 


Item Nos. 


No. of Items 


1. 


Safe and Orderly Environment 


1-5 


5 


2. 


Clear School Mission 


6-16 


11 


3. 


Instructional Leadership 


17-30 


14 


4. 


High Expectations 


31-40 


10 


5. 


Opportunity to Learn and Time on Task. 


41-49 


9 


6. 


Frequent Monitoring of Student Progress 


50-57 


8 


7. 


Home School Relations 


58-67 


10 
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Factor profiles were developed for each of the seven "effective schools" 
factors for: (a) each school staff responding to the survey; (b) the combined 
elementary school staffs responding to the survey (Appendix C); and (c) the 
combined middle school staffs responding to the survey (Appendix D) % 

Aft^r the survey was conducted, Evaluation Services processed and analyzed 
the data, preparing frequency distributions by item, factor profiles, and 
graphic representations of the factor profiles for each participating school. 
During October, 1986, Evaluation Services met with each principal to interpret 
the results and suggest possible ways to utilize the results. One possible way 
to use the results of the needs a.ssessment would be to prepare a prioritized 
list of needs for the particular school in terms of the seven factors related 
to "effective schools." This would enable the staff at each school to develop 
an action plan tailored to their particular needs. 

A frequency distribution of NAS respondents by position is summarized in 
Table 2 for middle schools, elementary schools, as well as fv^r the combired 
total. As indicated in the table, a total of 178 staff members responded to 
the survey. Of this number, 126, or 70.8% were regular classroom teachers. 

Table 2 

Frequency Distribution and Percent of NAS 
Respondents by Position and Level 



Level 

Position Middle Elementary T otal 

N % N % % 



Principal or Asst. Principal 


5 


3.5 


0 


0 


5 


2.8 


Regular Classroom Teacher 


97 


68.3 


29 


80.6 


126 


70.8 


Certificated Staff (e.g. 














Special Ed., CLEAR, Counselor) 


35 


24.7 


7 


19.4 


42 


23.6 


Other 


5 


3.5 


0 


0 


5 


2.8 


Total 


142 


100% 


36 


100% 


178 


100% 



An overall analysis of factor profiles for elementary schools (Appendix C) 
and middle schools (Appendix D) indicates that rhe majority of regular teacher 
responses were positive ("C" to "E"). At both the midr'le and elementary 
levels, factor profiles for Home-School Relations were less positive, with more 
than 40% of the responses in the "A" or **B" category. Item 60, regarding the 
low percentage of parents attending parent-teacher conferences, was an item 
receiving many lower ratings at both the elementary and middle school levels. 

An analysis of individual school staff response to the NAS "effective 
schools" factors revealed much variability from school to school in terms of 
the percent of staft members from each school who gave a positive response 
(marked response choice D or E) to the items composing the seven "effective 
schools" factors. The percent of staff members at a school who marked the 
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Table 3 

Needs Assessmsnt Survey (NAS) Analysis: 
Percent of Positive Responses for Each Eleraentary School by Factor, and 
Percent Difference from Average Percanr of Positive Responses of All Eleraantary Schools by Factor 



Factors 





Sale 
Environment 


Qear 
Mission 


Instructional 
Leadership 


High 
Expectations 


Time on Task. 


Frequent 
Monitoring 


Hone-School 
Relations 




1 

% 




2 

% 




3 

I 




4 

T 




5 

t 




6 

1 




7 




HUementary 
Schools 


Positive 
Response 


t Dift 
from 
Total 


Positive 
Response 


% Diff 
from 
Total 


Positive 
Response 
(1>E) 


t Diff 
from 
Total 


Positive t Diff 
Response from 
(DfE) Total 


Positive 
Response 
(DfE) 


% Diff 
from 
Total 


Positive 
Response 
(EH-E) 


% Diff 
from 
Total 


% 

Positive 
Response 
(DfE) 


% Diff 
frcra 
Total 


Medary 
Windsor 


44 
25 


+09 
-10 


74 
71 


•+02 
-01 


56 
47 


403 
-06 


52 
40 


-f05 
-07 


59 
52 


-K)3 
-04 


70 
81 


-06 
■K)5 


30 
30 


-0- 
-0- 


fclienfcntary 
School Total 


35 




/2 




53 




47 




56 




76 




30 
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Table 4 



Middle 
Schools 



Needs Assessment Survey (NAS) Analysis: 
Percent of Positive Responses for Eadi Middle School by Factor, and 
Percent Ditference from Average Percent of Positive Responses of Ail Middle Schools by Factor 



Factors 



Sate 
Environment 
1 

t 

Positive % Ditf 
Response from 
(DfEj ToLal 



Qear 
Mission 



% 

Positive % Dift 

Response from 

(Dt-E) Total 



Instructional 
Leadership 
3 

% 

Positive % Diff 
Response from 
(EH-E) Total 



High 
Expect ations 
4 

% 

Positive 
Response 



Time on Task 



% Uift 
from 
Total 



Positive 
Response 



% Dif f 
from 



Frequent 
Monitoring 
6 

% 

Positive % Diff 
Response from 



Home-SciKx>l 
Relations 



% 

Positive 
Response 



% Diff 
from 



Beery 


63 


+17 


63 


-K)2 


63 


+22 


43 


¥\1 


46 


+01 


78 


+08 


32 


+05 


Everett 


46 


-0- 


51 


-10 


27 


-14 


32 


-04 


48 


+03 


73 


+03 


32 


+05 


Mahawk 


49 


•H)3 


68 


••07 


40 


-01 


42 


■K)6 


42 


-03 


64 


-06 


22 


-05 


Sta.-ilng 


29 


-17 


60 


-01 


30 


-11 


28 


-08 


45 


-0- 


69 


-01 


25 


-02 


MLddie 






























School Total 


46 




61 




41 




36 




45 




70 




27 





10 
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items positively within a factor was calculated for each elementary school, and 
then for all elementary schools. The d .iference between the percent positive 
response for each elementary school and the percent positive response for all 
elementary schools was then calculated. Those schools with a positive 
difference from the total of all elementary schools, had a greater percentage 
of positive response to a given factor than did elementary schools as a whole; 
those schools with a negative difference from the total of all elementary 
schools, had a smaller percentage of positive response ro a given factor than 
did elementary schools as a whole. The results for elementary schools is 
summarized in Table 3, while the results for middle schools is summarized in 
Table 4. The same results for elementary schools are summarized graphically uy 
factor in Appendix hi, vhile the middle school results are summarized 
graphically by factor in Appendix F. 

A review of Table 3 inaicates, for example, that Medary staff members were 
more positive about their school in terms of "Safe Environment." Windsor staff 
members, on the other hand, were less positive on the factor "Safe 
Environment/' Further review of Table 3 reveals the relative position of both 
elementary schools on the seven factors. 

Similarly, a review of Table 4 indicates that Beery 3taff mem.;ers were more 
positive about their school in terms of "Safe Environment," with a 17% 
difference, than the other middle schools. Starling staff members, on the 
other hand, were the least positive, with a -17% difference from the average 
middle school on t\,e factor "Safe Environment." Further review of Table 4 
reveals the relative position of each middle school on the seven factors, and 
how each school's percent of positive responses differs from the responses of 
all middle schools. 



Pre test-Post test Re salts 

A major characteristic of effective schools is the monitoring of pupil 
achievement in the basic skill areas. As part of this process, the pupils in 
26 schools were administered tests of basic mathematics and reading skills 
twice during the school year. The pretest was administered during the last 
week of September, 1986, and the posttest was administered during the first 
week of April, 1987. 

The two reading tests and two mathematics tests from the Comprehensive 
Tests of Basic Skills (CTBS; 1981) were used for grades 1-8. The CTBS tests 
used were: Reading Vocabulary, Reading Comprehension, Mathematics Computation 
(not part of the test used to pretest first-graders), and Mathematics 
Concepts/Applications. The Word Attack test was also administered to pupils in 
grades 1-3. Form U of the test was used throughout ail grade levels tested in 
the fall, as well as for grade 1 in the spring. Form V of the test was used in 
grades 3, 5, 6 < id 8 for the posttest in the spring. At grades 2, 4 and 7 
Customized Tests of Reading -^nd Mathematics were used in the spring posttest. 
The customized tests provided estimates of performance on the appropriate CTBS 
tests. The levels and forms of the test used for each grade level, for both 
the pretest and the posttest, are summarized in Table 5. The levels and forms 
of the test used were the same for both the reading and mathematics tests. 
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it uid be noted chat the comprehension test of vei B, which was 
administered to t irst-graders m the fail, is an jjai comprehension test. The 
comprehension cest ot Level C, which was administered to firi?* -graders in the 
sprmgj IS a read ing comprehension tesc* Si nc6 chess tvo lgs^s represent 
difterent skills, cautioa should be used :a Interpreting the results for 
reading comprehension tor f irst-grauers . The best indicator for re ding 
achievement tor r irst-graders is the total reading score* Levei B was used for 
grade i on the pretest because Level C reading tests, especially comprehension, 
proved too ditticuit for the first-graders at pretest time two years ago. 

Table 5 

CTBS Test Levels and Forms 
by Grade Level 



Pretest Posttest 



Grade 


Level 


Form 


Level 


Form 


1 


6 


U 


C 


U 


2 


0 


U 


D* 


V* 


3 


£ 


u 


E 


V 


4 


F 


u 


F* 


V* 


5 


G 


u 


G 


V 


6 


G 


u 


G 


V 


7 


H 


u 


H* 


V* 


8 


H 


u 


H 


V 



*Custorair^d Tests of Reading and Mathematics provided estimates' 
of performance on this CTBS test. 



To be included m the evaluation sample a pupil had to have taken a 
pretest and postrest in the same school and had to h^ve a valid score on both 
the pretest and the posttest. Also, pupils in kindergarten and special 
education classes were not included in the evaluation sample. Of the 10,350 
pupiis pretested, 8,354 (80.7%) met the selection criteria and were included in 
the evaluation sample. 

The remainder of this report is a description of the pretest-post test 
results. The reader is advisea that the values in the change columns in Tables 
7-17 may vary by one-tenth of a point from the values obtained from subtracting 
the pretest values from tiie posttest va^ '^-s. This variation is due to rounding 
and is not an error in computation. Also, m interpreting these results the 
reader should be aware of the types of scores used in carrying out the data 
analysis. First, the raw score is simply the number of items on which the 
pupil marked only the correct response. Second, the percentile (%ile) score 
indicates how the pupil's raw score compares with tne raw scores of the pupils 
m the norramg group. A percentile score of 70 indicates that the pupil did as 
well or better than 70% of the pupils in the norming group. The percentile is 
not an equal unit of measurement, tut does provide comparative information 
regarding the pupil's performance. Thiid, the normal curve equivalent (NCE) is 
a standard score with a mean of 50 and a standard deviation of about 21. 
Unlike the percentile, the NCE is an equal unit of measureraert. This means 
that the distance between any two points in the NCE distribution is the same 
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and represents the same amount o.^ change (see Appendix G tor the distribution 
of different types of scores). A major advantage of NCE scores is that 
arithmetic operations can be doPiC with them. For example, pretest-posttest 
chai.ge scores can he computed and averaged.. While percentile scores are uspd 
m this report, the NCE score represents the most accurate picture of pupil 
growth. The pretest-postLest analyses also provide the percent of pupils who 
scored at or above grade level and the percent of pupils who scored above the 
36th percentile. The latter analysis was done to depict the percent of pupils 
considered to be far enough below grade level to require remediation according 
to ECIA Chapter 1 state guidelines. 

Table 6 contains a summary of pretest, posttest, and change scores for the 
Word Attack Test (grades 1-3) tor all participating schools reported by grade 
level. The data in Table 6 show that the total average growth in Word Atta^^.k 
skills for all pupils was greater than expected. While the expected NCE change 
tor the normal school population is zero NCE points during the course of a 
school year, the total average change for participating schools was 4.1 NCE 
points. The greatest average gain in NCE points was achieved at grade 3 with 
12. U NCE points, while a slight loss was encountered at grade 1 with -1.3 NCE 
points. The average NCE score on the posttest was 45.7, whereas the norm 
group, or national average would be 50.0. 

For the V» >rd /attack Te't, 29.4% of the pupils were at grade level on the 
pretest, while 42.1^ of th3 pupils were at grade level on the posttest for a 
gain of 12-7;^. Grade 3 showed nh- - reatest increase in pupils at grade level 
from pretest to posttest with 29 hile grade 1 showed the smallest increase 

m pupils at grade level from prer.e. co posttest with 2.1%. 

Table 7 contains a summary of pretest, posttest, and change scores for the 
Reading Vocai" ilary Tc^st (grades 1-8) tor all participating schools reported by 
grade level. The data in Table 7 show that the total average growth in Reading 
Vocabulary skills for all pupils was greater than expected. While the expected 
NCE change for the normal school population is zero NCE points during the 
course of a school year, the total average change for participating schools was 
2.9 NCE points. The greatest average gain m NCE points was achieved at grade 
4 with 6.7 NCE points, while a slight loss of -1.0 NCE points was encountered 
at grade 1. The average NCE score on the posttest was 47.4, whereas the norm 
group, or national average would be 50.0. 

For the Reading Vocabulary Test, 35.0% of the pupils were at grade level 
on the pretest, while 42.8% of the pupils were at grade level on the posttest 
for a gain of 7.8%. Grade 4 showed the greatest increase in pupils at grade 
level from pretesL to posttest with 12.4%, while grades 3 and 6 showed the 
smallest increases m pupils at grai'e level from pretest to posttest with 3.2%. 

Table 8 contains a summary of pretest, posttest, and change scores for the 
Reading Comprehension Test (grades 1-8) for all p^rticipating schools reported 
by grade level. The data in Table 8 siiow that the total average growth in 
Reading Comprehension skills for all pupils was slightly greater than 
expecued. While the expected NCE change for the normal school populat ion is 
zero NCE points during the course of a school year, the total average change 
for participating schools was 2.1 NCE points. The greatest average gain in NCE 
points was achieved at grade 7 with 5.9 NCE points, while grades 2 and 5 showed 
losses ot -0.5 and -0»8 NCE points respectively. The average NCE score on the 
posttest was 47.8, whereas the norm g^'oup, or national average would be 50.0. 
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MEDIAN PERCENTILE/ •^E^N NORMAL CURVE FQUIVALENT# 
PERCENT AT GRADE LEVEL# AND PERCENT ABOVE THE 36TH PERCENTILE 
fOPs THE POSTTEST# PRETEST^ AND CHANGE "CORES FOR 
CTBS WORD ATTACK (GRADES 1-3) REPORTED «5Y GRADE LEVEL 









POST 


TEST 




< 


PRE 


TEST 






CHANGE 




GRADE 


NO. 


MEDIAN 




X AT 


X ABOVE 


MEDIAN 


MEAN 


X AT 


X ABOVE 


MEAN 


X AT 


X ABOVE 


LE VEL 


TESTED 


XILE 


NCE 


GR. LV. 


36 XILE 


XILE 


NCE 


GR. LV. 


36 XILE 


NCE 


GR. LV^ 


36 XILE 


1 


701 


36.0 


42. 9 


34.5 


4 7.6 


34.0 


44.2 


32.4 


47.1 


-1.3 


2.1 


. 6 


2 


6?5 


36.0 


43. 4 


39.0 


49.1 


29.0 


42.4 


33.8 


45.6 


1.0 


5.3 


3.5 


3 


713 


52.0 


50.5 


52.2 


71.4 


30,0 


38. 5 


22.7 


45.3 


12.0 


29.5 


26. 1 


TOTAL 


303O 


43.0 


45. 7 


42.1 


56.4 


33.0 


41,7 


29.4 


46.0 


4.1 


12.7 


10.4 
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TABLE 7 



MEDIAN PERCENTILE* '"^EAN NORMAL CURVE EQUIVALENT* 
PE9CENT AT GR^DE LEVEL* ^ND PERCENT ABOVE THE 36TH PERCENTILE 
FOR THE POSTTEST* PRETEST^ AND CHANGE SCORES FOR 
CT8S READING VOCABULARY (GRADES 1-8) REPORTED BY GRADE LEVEL 









POST 


TEST 






PRE 


TEST 






CHANGE 




GRADE 
LF VEL 


NO* 

TESTED 


MEDIAN 
XILE 


MEAN 
NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


MEDIAN 
XILE 


MEAN 
NCE 


X AT 
GR. LVo 


X ABOVE 
36 XILE 


MEAN 
NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 




714 


40.0 


44.5 


37.8 


51.1 


38.0 


45. 6 


32.9 


59.4 


-1.0 


4.9 


-8. 3 




545 


43.0 


48. 7 


45.0 


55. 6 


34.0 


46. 3 


38.0 


48.4 


2.4 


7.0 


7«2 




710 


35.0 


42.4 


35.9 


48.6 


3 3.0 


40.9 


32.7 


43.4 


1.4 


3.2 


5. 2 




16?1 


47.0 


49. 3 


45.6 


65.0 


34.0 


42.6 


33.2 


46.5 


6.7 


12.4 


18.5 




1540 


46.0 


49.4 


47.6 


64. 2 


41.0 


46.9 


39.5 


56.0 


2.5 


8.1 


8. 2 




1^.14 


44.0 


47.2 


40.3 


61.6 


41.0 


45.9 


37.1 


58.2 


1.3 


3.2 


3. 5 




1036 


46.0 


48.1 


43.1 


65.0 


36.0 


42. 9 


30.9 


48. 3 


5. 2 


12.3 


16. 7 


8 


95 6 


43.0 


45.4 


41. 1 


58.2 


38.0 


44.0 


34.5 


51.5 


1*4 


6.6 


6. 7 


TOTAL 


8536 


44.0 


A7.4 


42.8 


60.4 


38.0 


44. 4 


35.0 


51.7 


?.9 


7.8 


8. 7 



i ^1 



± ..J 



o 



TABLE 8 



lEDlAN PERCFNTILE* HEAN NOR^IAL CURVE EQUIVALEHT^ 
PERCENT AT GRADE LEVFL# AND PERCENT ABOVE THE 36TH PERCENTILE 
FOR TfJE POSTTEST*^ PRETEST# AND CHANGE SCORES ^OR 
CT8S READING COMPREHENSION (GRADES 1-8) REPORTED BY GRADE LEVEL 



POST TEST 



PRP TEST 



GRADE 
LEVEL 


NO. 

TES TED 


MEDIAN 
X I LE 


MEAN 

NC E 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


MEDI AN 
XILE 


MEAN 
NCE 


X AT 
GR. LV. 


X A90VE 
36 XILE 


1 


71 0 


39.0 


46. 0 


41.3 


55.6 


28.0 


42.5 


36.1 


48.0 


2 


51 1 


45.0 


46.5 


46.8 


57. 3 


41.0 


47. 0 


38.9 


51.3 


3 


719 


42.0 


47.2 


43.8 


58. 3 


32.0 


42. 4 


34.9 


46.0 


A 


160 2 


46.0 


48. 3 


43.4 


64.4 


41.0 


47. 2 


41.4 


55.6 


5 


1SA3 


41.0 


A7. 4 


39.0 


56. 3 


45.0 


48. 2 


45.0 


60.4 


6 


1??1 


30. 0 


46. 7 


37.9 


55.6 


58.0 


4 3. 6 


35.9 


50. 5 


7 


1004 


51.0 


50. 7 


52.1 


69. 1 


41.0 


44.8 


33.1 


55.3 


8 


96 2 


46.0 


48. ^ 


44.1 


59. 3 


43.0 


46.4 


45.3 


57.0 


TOTAL 


«?7? 


44.0 


47.8 


43.0 


59.8 


40.0 


45. 6 


40.1 


54- 1 





CHANGE 




MEAN 
NCE 


X AT 
GR. LV. 


X A90VE 
36 XILE 


3.6 


5.2 


7. 6 


5 


7.8 


6. 1 


4.8 


8.9 


12.2 


1,0 


2.1 


8. 8 


-.8 


-6.0 


-4.1 


3.2 


2.0 


5.2 


5.9 


1 :.9 


1 3. 8 


1.8 


-1.2 


2. 3 


2.1 


2.8 


5. 7 
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For the Reading Comprehension Test, 40.1% of the puplis were at grade 
ievei on the pretest, while 43.0% of the pupils were at grade level on the 
posttest for a gain of 2.8%. Grade 7 showed the greatest increase in pupils at 
grade ievei from pretest to posttest witn 13.9%, while grades 5 and 6 showed 
decreases in pupils at grade level from pretest to posttest with -6.0% and 
-1.2% respectively. 

Table 9 contains a summary of pretest, posttest, and change scores for 
Total Reading (grades 1-8) for all participating schools reported by grade 
level. The data in Table 9 show that the total average growth in Total Reading 
skills for all pupils was greater than expected* While the expected NCE change 
for the normal school population is zero NCE points during the course of a 
school year, the total average change for participating schools was 2.5 NCE 
points. The greatest average gain in NCE points was achieved at grade 7 with 
5.7 NCE points, while average growth was achieved at grade 2 with 0.0 NCE 
points . The average NCE score on the posttest was 47.3, whe re as the norm 
group, or national average would be 50.0. 

For Total Reading, 36.3% of the pupils were at grade level on the pretest, 
while 41.0% of the pupils were at grade level on the posttest for a gain of 
4.7%. Grade 7 showed the greatest increase i.i pupils at grade level from 
pretest to posttest with 11.8%, while grade 5 s'lowed no increase in pupils at 
grade level from pretest to posttest with 0.0%. 

Table 10 contains a summary of pretest, posttest, and change scores for 
tie Mathematics Computation Test (grades 2-8) for all participating schools 
reported by grade level. The data in Table 10 show that the total average 
growth in Mathematics Computation skills for all pupils was greater than 
expected. While the expected NCE change for the normal school population is 
zero NCE points during the course of a school year, the total average change 
for participating schools was 13.0 NCE points. The greatest average gain in 
NCE points was achieved at grade 4 with 18.1 NCE points, while the smallest 
gain was achieved at grade 8 with 6.0 NCE points. The average NCE score on the 
posttest was 55.0, whereas the norm group, or national average would be 50.0. 

For the Mathematics Computation Test, 33.7% of the pupils were at grade 
level on the pretest, while 59.6% of the pupils were at grade level on the 
posttest for a gain of 25.9%. Grade 5 showed the greatest increase in pupils 
at grad3 level from pretest to posttest with 33.7%, while grade 7 showed the 
smallest increase in pupils at grade level from pretest to posttest with 18.2%. 

Table 11 contains a summary of pretest, posttest, and change Sv,ores for 
the Mathematics Concepts and Applications Test (grades 1-8) for all 
participating schools reported by grade level. The data in Table 11 show that 
the total average growth in Mathematics Concepts and Applications skills for 
all pupils was greater than expected. While the expected NCE change for the 
normal school population is zero NCE points during the course of a school year, 
the total average change for participating schools was 7.6 NCE points. The 
greatert average gain in NCE points was achieved at grade 1 with 13.2 NCE 
points, while grade 8 showed a small gain of 0.1 NCE points. The average NCE 
score on the posttest was 32.0, whereas the norm group, or national average 
would be 50.0. 

For the Mathematics Concepts and Applications Test, 38.1% of the pupils 
were at grade level on the pretest, while 51.6% of the pupils were at grade 
level on the posttest for a gain of 13.5%. Grade 1 showed the greatest 
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TABLE 9 

MEDIAN PERCENTILE^ flEAN NORMAL CURVE EQUIVALENT* 
«>E«?C6?<T AT GRADE LEVEL^ AND PERCENT ABOVE TME 36TH PERCENTILE 
fO? THE POSTTEST* PRETEST* AND CHANGE SCORES FOR 
CTBS TOTAL READING (GRADES 1-8) REPORTED BY GRADE LEVEL 



POST TEST 



P^?E TEST 



CHANGE 



GR ADE 
LEVEL 


NO, 

TESTED 


~ t V i ^ n| 

XILE 


^E A N 

NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


MEDIAN 
XILE 


f^EAN 
NCE 


X AT 
G R. L V. 


X ABOVE 
36 XILE 


MEAN 


X AT 
vjk. lV« 


X ABOVE 
36 X I lE 


1 


700 


40.0 


45. 3 


40.4 


55.4 


36.0 


43. 3 


34.1 


47.4 


2.0 


6.3 




2 


606 


39.0 


44.9 


38.3 


52. 3 


32.0 


44.9 


34.8 


44« 2 


-.0 


3.5 


8. 1 


3 


693 


4no 


45.7 


38.8 


^6.4 


32. 0 


41. 4 


32.9 


45*3 


4.3 


5.9 


1 1 • 1 


4 


16?6 


45*0 


48.3 


42.3 


65.4 


38.0 


45.1 


38.1 


53*0 


3.2 


4.1 


12.4 


5 


1535 


43.0 


48. 1 


41.2 


61.0 


43.0 


47. 6 


41.? 


58*6 


• 5 


«0 


2.5 


6 


1203 


41 .0 


46. 9 


38.9 


57.4 


38.0 


44.5 


33.7 


52.9 


2.4 


5.2 


4.5 


7 


1030 


46.0 


49. 3 


43.9 


67.0 


37.5 


43.6 


32.0 


52.2 


5.7 


11.8 


14.8 


8 


950 


43.0 


46. 9 


41.6 


57.9 


40. 0 


45.3 


37.9 


55.1 


1.7 


3.7 


2.8 


TOTAL 


8343 


4-5.0 


47. 3 


41.0 


60. 3 


38. 0 


44. H 


36.3 


52.4 


2.5 


4.7 


7.9 



2'' 




TABLE 10 



•leOIAN PERCENTILE^ ^EAN NOR^^AL CURVE EQUIVALENT/ 
PERCENT AT GRADE LEVEL# AND PERCENT ABOVE THE 36TH PERCENTILE 
FOR THE POSTTEST# PRETEST^? AND CHANGE SCORES FOR 
CTBS HATH CO^IPUTATION (GRADES 2-8) REPORTED GRADE LEVEL 









POST 


TEST 






PRE 


TEST 






C H ANo t 




GRADE 
LE VEL 


NO. 

TESTE D 


MEDIAN 
XILE 


PIE AN 
NCE 


X AT 
GR. LV. 


X ABOVE 
56 XILE 


MEDIAN 
XILE 


WEAN 
NCE 


X AT 
6R. LV. 


X ABOVE 
56 XILE 


HE AN 

NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


2 


S04 


61. n 


54. 8 


67.1 


78. 2 


37.0 


46. 5 


36.9 


55.4 


8.3 


50.2 


22. 8 


3 


72 S 


46.0 


48.4 


49.7 


55.4 


24.0 


55.8 


25. 0 


38.1 


1 2.6 


24-^7 


1 7.4 


4 


1531 


58. n 


56.7 


55.8 


66. 2 


26.0 


58. 6 


29.0 


40.4 


18.1 


26.8 


25. 8 


S 


1544 


65.5 


>7. 1 


65.2 


74.2 


36.0 


43.0 


31.^. 


46. ? 


14.1 


53.7 


28.0 


6 


1207 


65.0 


55.7 


63.7 


70.8 


37.0 


42. 5 


38.7 


51.8 


13.2 


25.0 


19. 0 


7 


972 


64. n 


56.9 


61.4 


70. 1 


43.0 


44. 5 


45.2 


59.9 


1 2.6 


18.2 


10. 2 


8 


979 


55.0 


SI. 2 


55.5 


62.1 


57.0 


45.2 


54.2 


50.8 


6.0 


19.3 


11.3 


TOTAL 


7462 


60.0 


S5.0 


59.6 


68. 3 


55.0 


42*0 


35.7 


48.1 


13.0 


25.9 


20. 2 
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TABLE 11 



MEDIAN PERCENTIL./ MEAN NORMAL CURVE EQUIVALENT^ 
PERCENT AT GRADE LEVEL/ AND PERCENT ABOVE THE 36TH PERCENTILE 



6R AD 
LE VE 



8 

TO TAL 





C ^BS 


fOR THE 
MATH CONCEPTS 


POSTTEST# PRETEST/ AND 
% APPLICATIONS (GRADES 


CHANGE SCORES 
1 -8) REPORTED 


FOR 

BY GRADE LEVEL 










< 


POST 


TEST 






PRE 








CHANGE 












1 c ^ 








NO. 

TES TED 


MEDIAN 
X ILE 


MEAN 
NCE 


X \J 
GR. LV 


X A80V, 
. 36 XILE 


MEDI AN 
XIL6 


MEAN 
NCE 


X AT 
GR. Iv 


X A90VE 

. 36 xr.E 


MEAN 

NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


70 5 


56.0 


50. 8 


51.9 


64.4 


25.0 


37,6 


24.7 


32. 5 


13.2 


27.2 


31.9 


639 


4 4.0 


49.8 


44.9 


58. 1 


37.0 


43.5 


35.2 


53.8 


6.3 


9.7 


4.Z' 


7^0 


4 6.0 


49.0 


42.8 


62.4 


34. 0 


41. 3 


^3.9 


47. 5 


7.8 


8.9 


1 4.9 


15AB 


51.0 


56. 1 


51.7 


69.9 


41.0 


44.9 


39.3 


55 5 


11.2 


12.3 


1 4. 4 


1S3A 


56.0 


5?*4 


58.6 


71.1 


46.0 


47. 7 


43.8 


64.0 


4.7 


14.8 


7. 1 


1206 


51.0 


51.0 


53.6 


67. 7 


42.0 


44.1 


3V.3 


54. 3 


6.9 


U.3 


13.3 


1019 


S8.0 


55. 7 


60.5 


76.2 


43.0 


44. S 


33.6 


58.6 


11.2 


26.9 


1 7.6 


98 3 


44.0 


47.0 


39.7 


57.1 


42. 0 


46.8 


45.3 


57. 3 


.1 


-5.6 


-.2 


«i3SA 


51.0 


s^.o 


51.6 


67.0 


41.0 


44. 5 


38.1 


54. 7 


7.6 


13.5 


12.3 
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increase in pupils at grade level from pretest to posttest with ll^V/^y while 
grade 8 showed a decrease in pupils at grade level from pretest to posttest 
with -5.6%. 

Table 12 contains a summary of pretest, posttest, and change scores for 
Total Mathematics (grades 2-8) for all participating schools reported by grade 
level. The data in Table 12 show that tne total average growth in Total 
Mathematics skills for all pupils was greater than expected. While the 
expected NCE cnange for the normal school population is zero NCE points duriag 
the course of a school year, the total average change for participating schools 
was 10.5 NCE points. The greatest average gain in NCE points was achieved at 
grade 4 with 15.4 NCE points, while grade 8 showed a small gain of 3.5 NCE 
points. The average NCE score on the posttest was 53.6, whereas the norm 
group, or national average would be 50*0. 

For Total Mathematics, 35.3% of the pupils were at grade level on the 
pretest, while 55.5% of the pupils were at grade level on the posttest for a 
gain of 20.2%. Grade 5 showed the greatest increase in pupils at grade level 
from pretest to posttest with 26.8%, while grade 8 suowed the smallest gain in 
pupils at grade level from pretest to posttest with 6.6%. 

A major theme ol most of the literature on etfective schools is that a 
school is effective if the economically disadvantaged pupils in the school 
learn the basic skills to the same extent as pupils not economically 
disadvantaged. Analyses of the pretest-post test data were made to determine 
the degree ' o which the achievement gains of pupils in the school district 
subsidized lunch program were comparable to the gains of pupils not in the 
lunch program. A pupil whose Student Master File record indicated that the 
pupil was receiving either a free or reduced price lunch was included in the 
subsidized lunch group. The achievement gains of these pupils were compared 
wich the gains of pupils not involved in the subsidized lunch program. 

Tables 13 and 15 contain a summary of the pretest, posttest, and change 
scores for the CTBS Total Reading Test (grades 1-8) reporteu by subsidized 
lunch category. Of the 8,343 pupils tested, 71.5% (5,965) 'ere counted in the 
subsidized lunch category. At each grade level, for both the pretest and the 
posttest, the mean NCE was lower for the pupils in the subsidized lunch 
category. At many grade levels the difference between the means for the two 
categories was substantial. The difference between the percent at or above 
grade level and the percent above the 36th percentile for the two categories 
was consistently in the same direction as the NCE results. 

When pretest-post test change was compared, mean NCE change wao found to be 
slightly larger for the pupils in the subsidized lunch category in all grades 
but 6. Based upon the data contained in Tables 13 and 15 pupils in the 
subsidized lunch category tended to: (a) score lower on the pretest; (b) 
score lower on the posttest; and (c) show slightly greater growth between the 
pretest aad Lhe posttest. 

Tables 14 and 16 contain a summary of the pretest, posttest, and change 
scores for the CTBS Total Mathematics Test (grades 2-8) reported by subsidized 
lunch category. Of the 7,661 pupils tested, 71.5% (5,483) were counted in the 
subsidized lunch category. At each grade level, for both the pretest and the 
posttest, the mean NCE was lower fo: the pupils in the subsidized lunch 
category. ^^e difference betv^een the percent at or above grade level and the 
difference bet.'^en the percent above the 36th percentile for the two categories 

O 
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TAQLE 12 

HeOlAN PERCENTILE* «EAN NORHAL CURVE EQUIVALENT* 
PERCENT AT GRADE LEVEL* AND PERCENT ABOVE THE 36TH PERCENTILE 
FOR THE f>OSTTEST* PRETEST* AND CHANGE SCORES FOR 
CTBS TOTAL MATHMATICS (GRADES 2-8) REPORTED BY GRADE LEVEL 



POST TEST 



PRE TEST 



GRADE 
LC Vt L 


NO. 

TES TE D 


MEDIAN 

t T 1 F 


^EAN 
N L t 


X AT 

no 1 If 
VJ K « L V. 


X ABOVE 
5 6 * I L t 


MEDIAN 
X ILE 


MEAN 
NC E 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


2 


6?S 


52.0 


51.9 


53.0 


65.8 


37.0 


44. 8 


54.2 


50.4 


3 


71? 


45.5 


48.7 


46.3 


59.8 


30.0 


38. 5 


29.9 


42.5 


4 


160u 


S2.0 


S5. 3 


52.6 


66.3 


31.0 


59. 9 


28.7 


45.2 


5 


1S30 


60.0 


S5.6 


63.: 


74.7 


40.0 


44. 7 


56.5 


53.4 


6 


119^ 


60.0 


54.9 


62.2 


75.2 


41.0 


44. 7 


40.6 


54.7 


7 


102A 


56.0 


SS. 2 


59.4 


72.9 


40.0 


44. 1 


40.2 


56.8 


8 


970 


45. 0 


49.0 


43.9 


60.7 


40.0 


45. 6 


57.5 


56.2 


TOTAL 


7661 


5S.0 


53.6 


55.5 


68.6 


37.0 


45.1 


55.5 


51.0 





CHANGE 




MEAN 
NCE 


X AT 
GR. LV. 


X ABOVE 
56 XI LE 


7.2 


18.7 


15. 4 


10.4 


16.4 


17.6 


1 5.4 


23.8 


25.0 


11.0 


26.8 


21. 5 


10. 2 


21.6 


18.5 


n. i 


19.2 


16. 1 


3.5 


6.6 


4. 5 


10.5 


20.2 


17.6 



on 
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TABLE 13 



Tz^.. ^^^.^^ ^C^' PERCENT AT GRADE 
^6TH PERCENTILE FOR THE POSTTEST/ 
^^^S TOTAL READING 
REPORTED OY SUBSIDIZED LUNCH 



LEVEL AND PERCENT ABOVE 
CATEGORY WITHIN GRADE LEVEL 













POSTTEST 

X AT 
GR, LV. 












GR ^DE 
Lr vc L 


SUBSIDIZED 
LDNCH 


NO. 

TESTED 


iEAN 

NCE 


X ABOVE 
36 XILE 


'^E A N 
NCE 


PRETEST 

* AT 

GR. LV. 


X ABOVE 
36 XILE 




1 


YES 


k9^ 


41.9 


33.6 


49.7 


39.4 


24.8 


39. 1 


GRADE 




MO 


20O 


53.2 


56.5 


68.9 


52. 3 


56.0 


67.0 


Tft T« 1 




'00 


45.3 


40.4 


55.4 


43. 3 


34.1 


47.4 




2 


YPS 


416 


40.9 


?9.« 


45.7 


40.6 


26.4 


35.8 






NO 


lOQ 


53.5 


56.8 


66.8 


54. 4 


53.2 


62.6 


GRADE 


TOTAL 




606 


44.9 


38.3 


52.3 


44.9 


34.8 


44.2 




5 


YES 


520 


42.9 


31.2 


49.6 


38. 1 


24.0 


37.5 


GRADE 




NO 


173 


54.3 


61.8 


76.9 


51.3 


59.5 


68.8 


TO TA L 




69^ 


45.7 


38.8 


56.4 


41.4 


32.9 


45.3 






YES 


1 200 


45.8 


34. 0 


59.8 


41.5 


31.0 


46. 1 


GRADE 




NO 


41 7 


55.4 


63.5 


81.8 


55.4 


•^8.8 


73.1 


TO T AL 




1626 


4S. 3 


42.3 


65.4 


45. 1 


38. 1 


53.0 




5 


YES 


1 135 


45.1 


33.7 


53.6 


44. 1 


33.6 


52.4 


GRADE 




NO 


400 


56.8 


62. 5 


82.3 


57. 3 


63.0 


76.0 






1 535 


48.1 


41.2 


61.0 


47.6 


41.2 


58.6 




6 


YPS 


864 


44. 1 


32.2 


50.7 


41.8 


28.0 


45.9 






NO 


^^0 


54.0 


56.0 


74.3 


51.3 


48^4 


70.5 


GRADE 


Tfl T A i 




1 


46.9 


38.9 


57.4 


44. 5 


3 3.7 


52.9 




7 


YES 


71 1 


47.4 


37.3 


62.0 


41.5 


27.0 


46.4 


GRADE 




NO 


319 


53.5 


58.6 


78.1 


48. 4 


4 3. \ 


65. 2 


TOTAL 




1030 


49.3 


43.9 


67.0 


43.6 


32.0 


52.2 




R 


YES 


610 


44.3 


35.4 


52. S 


42.4 


32. 3 


49.8 






NO 


331 


51.9 


53.2 


68.0 


50. 7 


48. 3 


65.0 


GRADE 


TOTAL 




950 


46.9 


41.6 


57.0 


45. 3 


37.9 


55.1 




TOTAL 




«343 


47.3 


41.0 


60.3 


44.8 


36. 3 


52.4 



CHANGE 



HEAN 
NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


2.5 


8.8 


1 0. 6 


.8 


• 5 


1.9 


2.0 


6.3 


8. 0 


. 3 


3.4 


9. 9 


-.9 


5« 7 


4. 2 


-.0 


3.5 


8. 1 


4. 8 


7 , 1 


1 2. 1 


3.0 


2.3 


8. 1 


4.3 


5.9 


11.1 


4.3 


3.9 


1 3.7 


-.1 


4.8 


8.6 


3.2 


4.1 


1 2.4 


.9 


. 2 


1 . 1 


-.5 


-.5 


6. 2 


.5 


-.0 


2. 5 


2. 3 


4.2 


L 7 


2.7 


7.7 


3.8 


2.4 


5.2 


4.5 


5.9 


10.3 


1 5.6 


5.1 


15.4 


1 2.9 


5.7 


11.8 


1 4.8 


uo 


3.1 


2.7 


1.2 


4.8 


3.0 


1.7 


3. 7 


2.8 


2.5 


4.7 


7.9 



00 



TABLE U 



^.r r. ^CE/ PERCENT AT GRADE 

36TH PERCENTILE ^OH THE POSTTEST* 
CTSS TOTAL MATHEMATICS 
REPORTED BY SUBSIDIZED LUNCH 



LEVEL AND PERCENT ABOVE 
PRETEST ^ND CHANGE SCORES POR 
TEST (GR.^CSS 2-8) 
CATEGORY WITHIN GRADE LEVEL 



GRADE 



GRADE 



GRADE 



GRAD5 



GRADE 



GRADE 



GRADE 











POS TTE ST 






O D c r C C T 

T AT 
GR. LV. 










GR ^DE 
LE VFL 


SUBSIDIZED 
LUNCH 


NO. 

TESTED 


MEAN 
NCE 


X \J 
GR. LV. 


X A90VE 
36 XILE 


ME A N 
NCE 


y A Q n c 

36 XILE 


MEAN 

NCE 


CHANGE 

X AT 
GR« LV. 


X ABOVE 
36 XILE 


2 


YES 




48.^ 


46.5 


61.1 


^2. 1 


27. 4 


45.6 


6« 3 


19.1 


1 5.4 




NO 


191 


60.0 


67. 5 


76.4 


50. 9 


49. 7 


61. 3 


9. 1 


17.8 


15.2 


TO T AL 




62 5 


5U9 


53.0 


65.8 


44. 8 


34. 2 


50.4 


7.2 


18.7 


1 5.4 


3 


YES 


S40 


45.1 


39.1 


54.1 


34. 7 


21. 9 


34.6 


10.4 


17.2 


19.4 




NO 


172 


60.0 


69.? 


77.9 


49. 6 


55. 2 


o6. 3 


1C.4 


14.0 


1 1.6 


TOTAL 




71? 


48. 7 


46. 3 


59.8 


38. 3 


29.9 


42o 3 


10. 4 


16-4 


1 7.6 




YES 


11Q? 


51.6 


46.0 


60.5 


36* 4 


22.4 


37.1 


15.2 


23.6 


23.4 




NO 


4U 


65.9 


71.5 


82.9 


50. 0 


46. 9 


60.9 


1 5.8 


24.6 


22.0 


TOTAL 




1606 


55.3 


S?.6 


66.3 


39. 9 


28.7 


43.2 


15*4 


23. 8 


23.0 


5 


YES 


112Q 


52.2 


S7.0 


69.8 


41.9 


30. 0 


46.8 


10*4 


27.0 


23.0 




NO- 


401 


65.3 


B1.0 


88.5 


52. S 


54. 9 


7^. 1 


12*8 


26. 2 


1 6.5 


TOTAL 




1S30 


55.6 


63. 3 


74.7 


44.7 


36. 5 


53.4 


11.0 


26.8 


21.3 


6 


YES 


151 


52.0 


57.2 


69.9 


42.5 


35. 7 


50. 1 


9. 5 


21. 5 


1 9.9 




NO 


341 


61.9 


74.5 


81.5 


50. 1 


52. 8 


66. 3 


11.8 


21 .7 


15.2 


TO T AL 




1 19? 


54.9 


6?. ? 


73.2 


44.7 


40. 6 


54. 7 


10. 2 


21.6 


1 8.5 


7 


YES 


709 


5^6 


55.7 


70.7 


42. 8 


36.8 


53.9 


10. 8 


18.9 


1 6.8 




NO 


317 


58.7 


67. 5 


77.9 


46. 9 


47. 6 


63.4 


11.8 


19.9 


14.5 


TOTAL 




10?6 


55.2 


59.4 


72.9 


44. 1 


40. 2 


56.8 


11.1 


19.2 


16.1 


8 


VPS 


6?8 


47.1 


39.6 


57.3 


43.? 


31. 7 


51.1 


3. 9 


8.0 


6.2 




NO 


34 2 


52.7 


51.8 


67.0 


49, 9 


47. 7 


65.5 


2.8 


4.1 


1.5 


TOTAL 




970 


49.0 


^3.9 


60.7 


45.6 


37. 3 


56.2 


3.5 


6.6 


4. 5 


TOTAL 




^661 


53.6 


55.5 


68.6 


43. 1 


35. 3 


51.0 


10. 5 


20«2 


1 7.6 
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TABLE 15 

SEAN NORMAL CURVP EQUIVALENT^ PERCENT AT GRADE LEVEL* 
^ND PtRCENT ABOVE THE 36TH PERCENTILE 
FOR THE POSTTEST* PRETEST^ AND CHANGE SCORES FOR 
CTBS TOTAL READING (GRADES 1-8) 
REPORTED BY SUBSIDIZED LUNCH CATEGORY 







< 


POSTTE ST 






PRETEST 
























CHANGE 




8SI0I7^:D 
LUitCN 


NO, 
TESTED 


MEAN 
NCE 


X AT 
GR, LV. 


X ABOVE 
36 XILE 


MEAN 

NCE 


X AT 
GR. LV. 


X ABOVE 
36 XILE 


MEAN 
NCE 


X AT 
GR. IV, 


X ABOVE 
36 XILE 


YES 


5965 


44,5 


33.8 


54.1 


41.0 


29,3 


45.6 


2,9 


4. 


8.4 


NO 


2378 


54,? 


58.9 


75.7 


52.9 


53,8 


69^3 


1.4 


5.1 


6.3 


tota:. 


'^343 


47.3 


41.0 


60, 3 


44.8 


36. 3 


52.4 


2, 5 


4. 7 


7*9 
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TABLE 16 

'lEAN riOr,^,^L CURVE EQUIVALENT* PERCfNT AT GRADE LEVEL* 
AND PERCENT ABOVE THE 56TH PFTR6NTILE 
FOR THE POSTTEST* PRETEST* AND CHANGE SCORES FOR 
CTBS TOTAL 'lATHEMATICS (GRADES 2-B> 
REPORTED SUBSIDIZED LUNCH CATEGORY 



SUBSIDIZED 
LUNCH 

YES 

NO 

TOTAL 



NO* 

TP STED 

5483 
7661 



MEAN 
NCE 

50*6 

61.1 

S3.6 



POSTTEST 

X AT 
GR. LV. 

49.9 

69. 5 

55.5 



X ABOVE 
56 XILE 

64.2 

79.5 

68.6 



riEAN 
NCE 

40«4 

50.1 

43.1 



PRETE ST 

X AT 
GR. LV. 

29. 3 

50. 4 

^5. ^ 



X ABOVE 
36 XILE 

45.3 

65. :> 

51.0 



MPAN 
NCE 

10. 3 

11.0 

10. 5 



CHANGE 

X AT 
GR, LV. 

20. 6 

19.1 

20. 2 



X ABOVE 
36 XILE 

1 8.9 

14.2 

1 7.6 



ERLC 
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was coasistentiy in Che same direccion as the NCE results • 

When pretest-posttest change was compared, the mean NCE was found to be 
larger tor the pupils not in the subsidized lunch category in all grades but 3 
and 8. Based on the data containea in Tables 14 and 16, pupils in the 
subsidized lunch category tended to: (a) score lower on the pretest; (b) score 
lower on the posttesc; and (c) show slightly less growth between the pretest 
and the posttest. 



Summary 

Activities related to the effective schools effort for the 1986-87 school 
year included the following: 

1. Six schools, rour middle and two elementary, elected to administer the 
Neads Assessment Survey to teaching staft. The instrument, prepared 
by the Department of Evaluation Services, is based on seven factors 
considered characteristic of effective schools. While results varied 
from school to school, one factor in particular, home-school relations 
was identified by all staffs as an area where improvement was needed. 
This rinding is consistent with earlier administrations of the survey 
in other schools during the last four years. 

2. Pretest-posttest scores in both reading and mathematics were obtained 
from nearly 8,400 pupils in grades 1-8 attending the participating 
schools. Analyses of these scores, obtained from the Comprehensive 
Tests of Basic Skills (CTBS; 1981), showed the pupils' change in 
achievement was slightly greater than expected in Reading 
Comprehension. The growth in Mathematics Computation was substantial 
with 25.9% more of the pupils at grade level on the posttest than at 
grade level on the pretest. The comparable figure for Reading 
Comprehension was 2.S%. Analyses indicated that pupils from lower 
income families continued to score consistently lower in both reading 
and mathematics. This has been true for each of the five years that 
effective schools research has been in th« Columbus schools. In fact, 
the pattern of pupil growth in mathematics and reading, regardless of 
which standardized test was used, also has been consistent during the 
five years of effective schools research. The growth In pupil 
achievement as measured by NCE points and the percent of pupils at 
grade level from the fall pretest to the spring posttest has been 
consistently larger for mathematics than for reading. Table 17 
summarizes the achievement gains for all pupils in reading and 
mathematics for each of the five years that effective schools research 
has been conducted. 
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Table 17 

Aciiievement Gains as Measured 
by Change in NCE Points and Percent 
of Pupils at Grade Level from Pretest 
to Posttest in each Program Year 



Reading Mathe m atics 

Program Average NCE % at Grade Average NCE % at Grade 

Year Ciiange Level Change Change Level Change 



1932-83 4.2 11.9 13.6 31.4 

1983- 84 4.9 11.7 10.8 23.4 

1984- 85 0.6 0.5 9.5 19.2 
^85-86 2.9 3.1 12.7 25.8 

1981-87 2.1 2.8 13.0 25.9 
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Appendix A 
rchools Participating in Sit* 1982-1986 
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Schools Participating in SIP 
1932-1986 



Sch. 


School 


Code 


N3ni6 


132 




148 


Ij O O U \iX\J KJ L VI ij 


202 


Linmoor MS 


225 


Mohawk MS 


Ikl 


Starlincr 


254 


Wedfirewood MS 

f T \^ u v» wf vy vy u i & ^ 


324 


Beck ES 


394 


Devonshire ES 


410 


East Linden ES 


412 


Easti£ate KS 


414 


KA<?t*hAUpn FS 


424 


F^>ir ES 


42b 


Fairmoor ES 


46a 


Gladstone ES 


478 




481 


Highland ES 


502 


Kent ES 


51^^ 


Koebel ES 


525 


Linden ES 


545 


Medary ES 


583 


Pilgrim ES 


591 


Reeb ES 


595 


Salem ES 


607 


Second ES 


645 


Trevitt ES 


662 


West Broad ES 


6/4 


Windsor ES 



82-83 



^'i^^Si:. Year 

"83-84 ~8'4=85' 



X 
X 
X 



X 
X 
X 
X 

X 
X 
X 
X 
X 
X 



X 
X 

X 
X 
X 



X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 



85-8_6_ 
X 



X 
X 



X 
X 



X 
X 
X 
X 
X 
X 
X 
X 



X 
X 
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Appendix B 

Schools Parcicipacing in School-Wide Testing 
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1986-87 

Schools Participating in School-Wide Testing 



Sch. 

Code 



School 
Name 



^j; a d es Pj- one Principal 



Reason/Test 
Coordinator 



Area Executive 
Director 



070 

112 

132 

156 

202 

225 

242 

254 

266 

348 

396 

398 

410 

424 

466 

502 

528 

543 

545 

575 

583 

591 

607 

645 

662 

665 

674 



West HS 
Beecy MS 
Crestview MS 



**Everett MS 
Linmoor MS 



Mohawk MS 
Starling MS 
Wedgewood 
Wes tmoor 
Burroughs ES 
Douglas ES 
Linden Park ES 
East Linden ES 
fa:r ES 
Georgian Hts. 
Kent ES 
Livingston E3 
Maybury ES 
Medary ES 
Ohio ES 
Pilgrim ES 
Reeb ES 
Second ES 
Trevitt ES 
West Broad ES 
Westgate ES 
'Windsor ES 



9-12 

6-8 

6-8 

6-8 

6-8 

6-8 

6-8 

6-8 

6-8 



K, 



1-3 
1-5 
1-5 
1-5 
4-'> 
4-5 
4-5 

3- 5 
f-5 
1-3 

4- 5 
1-3 
1-3 



K, 4-5 



K, 
K, 



4-5 
4-5 
4-5 
4-5 



274-1197 
4?1-2810 

262- 2515 
299-1345 
294-4727 
128-4381 
274-8433 
276-6571 
279-8631 
274-4500 
252-1166 
268-6131 
471-9911 
258-9523 
276-5371 

252- 4997 
444-6806 
864-1560 

263- 1804 

253- 8659 
252-7415 
444-9861 
299-1105 
252-4963 
274-6571 
279-6339 
294-3721 



James Bailey 
Richard Orr 
James Osborn 
Frank Foreman 
George Rich 
William Lude 
Robert Cochrun 
Diane Warner 
Oan Spivey 
Keith Rinehart 
Catherine Noble 
Lois Camealy 
Erma Taylor 
Yvonne Jones 
Fred Burt 
Jane Leach 
Robert Pritts 
James Roy 
Marilyn Foreman 
Gwendolyn Lane 
Lillian Richardson 
Roger Veley 
William Thrasher 
Margaret PriHerman 
Charles Pfaltzgraf 
Krista Eisnaugle 
Evelyn Bell 



ACOT/Jane Pratt 
Request/ Violet Barnett 
Request/John Holland 
Request/Ruth Lapp 
Request/Al Woodford 
UDP/Roy McClelland 
Request/Beth Marlor 
UDP/James Fugate 
UDP/Alene Jones 
Request/Bill Stewart 
Request/Gean Norman 
Request/Lois Camealy 
Request/Jim Kraner 
Request/Sarahlynn Jackson 
UDP/Fred Burt 
Request/Jane Leach 
Request/Gordon Morris 
Lazarus/James Roy 
Request/Sharon Fergeson 
UDP/Janis Gruenhagen 
Request/Pam Innis 
Request/Carol Rood 
Request/William Thrasher 
Request/Gwendolyn Wade 
UDP/Sharon Anderson 
UDP/Thea Jones 
Request/Maija Niemi 



Walt Richardson 
Tim Ug 
Donald Taylor 
Donald Taylor 
Donald Taylor 
Walt Richardson 
Walt Richardson 
Walt Richardson 
Walt Richardson 
Don Cramer 
Edward Lay 
Edward Lay 
Edward Lay 
Shirley Mann 
Don Cramer 
Don Cramer 
Don Cramer 
Shirley Mann 
Ralph Pryor 
Don Cramer 
Don Cramer 
Shirley Mann 
Ralph Pryor 
Edward Lay 
Don Cramer 
Don Cramer 
Ralph Pryor 



Approximately 60 ninth graiers 

Administering the Needs Assessment Survey (NAS) 
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Appendix C 

NAS Faccor Profiles for Elementary Schools 
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School: Elementary Schools 
Date: 09/66 



NEEDS ASSESSMENT SURVEY FACTOR PROFILE 



Factor 



Item No. of 

Nos. Items N 



_Re^sj)on£e j:_hoice ^Percent 
A B C " ~D E 



1 Safe and Orderly Environment 



1-5 



29 



10 52 29 



2 Clear School Mission 



6-16 



11 



29 



10 18 44 29 



3 Instructional Leadership 



17-30 



14 



29 



14 27 32 20 



4 High Expectations 



31-40 



10 



29 



12 39 29 18 



5 Opportunity to Learn and Time on Task 41-49 



29 



12 30 31 25 



6 Frequent Monitoring of Student Progress 50-57 8 



29 



7 18 39 36 



7 Home-SchooL Relations 



58-67 



10 



29 



11 



31 28 22 
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Appendix D 
NAS Faccor Profiles for Middle Schools 



r o 

Q Ok, 
E RI C EVALSRVCS/ P 61 9/ RPTF INS 7 
07/20/87 



School: Middle Schools 
Date: 09/86 



NEEDS ASSESSMENT SURVEY FACTOR PROFILE 



Factor 



1 Safe and Orderly Environment 



Item 
Nos. 



i-5 



No. of 

Items N 



97 



Res ponse Choice^ Percent 
A b"" ~C '5 E 

2 11 A2 33 12 



2 Clear School Mission 



6-16 



11 



97 



12 25 A3 19 



3 Instructional Leadership 



1/ -30 



14 



97 



11 19 30 25 16 



4 High Expectations 



31-40 



10 



97 



8 19 37 24 12 



5 Opportunity to Learn and Time on Task 41-49 



97 



6 13 36 28 17 



6 Frequent Monitoring of Student Progress 50- 



57 



96 



5 8 17 34 37 



7 Home-School Relations 



58-67 



10 



97 



15 32 27 20 7 
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Appendix E 

Graphs of NAS Factor Profiles f^r Elementar^ ochools 



C 
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Needs Assessment Survey Fall, 1986 
Factor i Safe and Orderly lijivironnent 
Percent of Positive Responses (EH-fc;) 
N=29 Overall Elementary Average = 35% 



Pet, Pos, ~ 

Responses 0 10 20 30 40 50 60 70 80 100 

School (I>H£) H 1 i 1 1 1 \ 1 j , 1h , , , , , , , , ; 

545 ^fedary 16 44 j ^ 

674 Windsor 13 25 x 1 



Z)0 
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Needs Assessment Survey Fail, 1986 

Factor 2 Clear School Mission 
Percent of Positive Responses (WE) 
N=29 Ovcvali Elementary Average = 72% 



SchDoi 



Pet. Pos. 

Responses 0 10 
N (DH£) H 1 H 



20 30 40 50 
H 1— — I \ i 1 1 h- 



60 70 80 90 100 

—i 1 H 1 1 ! 1 1 h 



545 Medary 
674 Windsor 



16 



13 



74 



71 



l-x 
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Needs Assessment Survey Fail, 1986 
Factor 3 Instructional Leadership 
Percent of Positive Responses (WE) 
^*=29• Overall Elementary Average = 53% 



Pet* Pos. 

Responses 0 10 20 30 4^ 50 60 70 80 90 100 
School N (Di£) H i 1 1 i 1 1 1 1 1 1 1 1 1 \ 1 1 1 1 1 h 



545 l^dary 16 56 



674 Windsor 13 47 



xjj 



GO 
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Needs Assessment Survey Fail, 1986 

Factor 4 High Expectations 
Percent of Positive Responses (DfE) 
N=29 Overaii Eiemsntary Average = 47% 



Pet. Fos. 

Responses 0 10 20 30 40 50 60 70 80 90 100 
School N i,bHO H 1 1 j i ! 1 1 i 1 1 H 1 , 1 , ^ , , , . 



545 >fedary 16 52 

674 Wuidsor 13 40 



c: 
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Needs Assessment Survey Fail, 1986 
Factor 5 Opportunity to Learn and Time on Task 
Percent of Positive Responses (EH-E) 
N=29 OveraJi Eianentary Average = 56% 



Pet. Pos. 

Responses 0 10 20 30 40 50 60 70 80 90 100 

545 liedary 16 59 [^.^ 
674 Windsor 13 52 x I 



63 
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Nec<is Assessnent Survey Fall, 1986 
Factor 6 Frequent MDiiitoring of S^ident Pro^rc^s 
Percent of Positive Responses (OfE) 
N=29 Overall Elementary Average = 76% 



School 



Pet. Pos. 

Responses 0 10 
N (DfE) H 1 H 



20 



30 



40 



50 



H H i ! 1 i h 



60 70 80 90 100 
— I ) 1 ( 1 1 1 1 H 



b45 ^feclary 



16 



/O 



X 



674 Wiixisor 



13 



81 
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Needs Assessment Survey Fall, 1986 

Factor 7 Home School Relations 
Percent of Positive Responses (DfE) 
N=-29 Overall Elementary Average = 30% 



Pet. Pos. ^ 

Responses 0 10 20 30 40 50 60 70 80 90 

Sclx»l N (DfE) H 1 1 1 h i 1 1 i ^^ . ♦ 1 i , -„.. . _u 



545 ^feclary 16 30 



b74 Windsor 13 30 



C3 
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Appendix F 

Graphs of NAS Factor Profiles for Middle Schools 
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Needs Assessment Survey Fall, 1986 
Factor 1 Safe and Orderly Environment 
Percent of Positive Responses (Dffi) 
N=97 Overall Middle School Average = 46% 



School 



Pet. Pos. 

r jponses 0 



10 

H h- 



20 

H h- 



30 

H H 



40 

H K 



50 

H h- 



60 



70 

H f- 



80 



H 1 h 



90 
— H 



100 
— h 



112 Beery 



24 



63 



156 Everett 



13 



46 



225 M)hawk 



28 



49 



242 Starling 32 



29 
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Needs Assessment Survey Fail, 1986 

Factor 2 Clear School Mission 
Percent of Positive Responses (WE) 
\>H)7 Overall Middle School Average = 61% 



Pet. Pos. 

Responses 0 10 20 30 40 50 60 70 80 90 100 
School N (I>E) -i i i f ' 1 1 1 1 1 i 1 1 1 1 i I , ; I ; 



112 Beery 24 63 

156 Everett 13 51 



225 MDhawk 28 68 



242 Starlung 32 60 xj 
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Needs Assessment Survey Fail, 1986 
Factor 3 Instructional Leadership 
Percent of Positive Responses (!>£) 
N=97 Overall Middle School Average =^ 41% 
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(im:) h 1 1 1 1 1 H 
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Needs Assessment Survey Fall, 1986 

Factor 4 High Expectations 
Percent of Positive Rejponses (DfE) 
N=97 Overall Middle School Average = 36% 

PcF. Pos. 

Responses 0 10 20 30 40 50 60 70 80 90 100 



112 Beery 24 43 

156 Everett 13 32 

225 MDhawk 28 42 

242 Starling 32 28 
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Needs Assessment Survey Fail, 1986 
Factor 5 Opportunity to Learn and Time on Task 
Percent of Positive Responses (DfE) 
N^--^? Overall Middle School Average = 45% 



Pet. POs. 



Responses 0 10 20 30 40 50 60 70 80 90 

School JN_ (I>H£) H 1 1 1 i 1 1 1 \ 1 , , , , , 11,1 



112 Beery 24 46 

156 tverett 13 48 



225 MDhawk 28 42 

242 Starim^ 32 45 
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Needs Assessraent Survey Fail, 1986 
Factor 6 Frequent MDaltoring of Student Progress 
Percent of Positive Responses (EH-E) 
H==95 Overall I'ti.ddie SchooJ Average = 707o 
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Needs Assessment Survey Fail, 1986 

Factor 7 Home School Relations 
Percent of Positive Responses (EH-E) 
N=97 Overall Middle School Average = 27% 
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Appendix G 

Comparison of Various Scores Co che Normal Curve 
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• PERCENT OF SCQHt'o 
UNDER THE NORMAL CURVE 
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